Research in statistical education — planning of an international survey

As announced in the November 2000 issue of MathStats&OR [1], one of the projects supported by the Maths, Stats & OR Network funds is an international survey of research into pedagogic issues in statistics and OR. I am taking the lead on this and report here on the progress that has been made during the first year. A paper giving some background to the project and describing initial thinking on how it might be implemented was presented at the 53rd session of the International Statistical Institute in Seoul, Korea, in August 2001 in a session on The future of statistics education research [2]. It sounded easy. I considered that I was something of an expert on surveys having lectured on the topic for many years and having helped students and others who were doing surveys, particularly with the design of their questionnaires. Surely all I had to do was to draft a few questions, send them electronically to colleagues in statistical education who would be only to happy to respond, and summarise their responses? I should have learnt from my experience of advising all those students who thought that doing a survey was easy and to whom I had to explain that their ideas were too ambitious. There are several inter-related stages in survey research and it is important to think about these before rushing into the collection of data. In the case of the survey in question, this planning stage revealed several challenges. Surveys are usually done for a purpose so even before planning how to do them, it is advisable to think about the final product and the dissemination of results. This is the route I followed.

Interaction design for teaching visually impaired students

This paper reports on the findings for a study on improving interaction design for teaching visually impaired students. The crux of the problem is the ability to draw and understand diagrams. The cognitive issues are often underestimated with insufficient attention being given to the use of metaphors, etc. and "one size fits all solutions" are often the norm. The findings of the original seed funded project have led to design criteria and to an application for a large scale project, to produce generic tools and to enable multi-modal teaching and learning, with connotations for the mentally as well as physically impaired.

What students can tell about lecturers when they are teaching: manifestations of confident and under-confident lecturers

Delivering a lecture requires confidence, a sound knowledge and well developed teaching skills (Cooper and Simonds, 2007, Quinn and Hughes, 2007). However, practitioners who are new to lecturing large groups in higher education may initially lack the confidence to do so which can manifest itself in their verbal and non-verbal cues and the fluency of their teaching skills. This results in the perception that students can identify the confident and non-confident teacher during a lecture (Street, 2007) and so potentially contributing to a lecturer’s level of anxiety prior to, and during, a lecture. Therefore, in the current educational climate of consumerisation, with the increased evaluation of teaching by students, having the ability to deliver high-quality, informed, and interesting lectures assumes greater significance for both lecturers and universities (Carr, 2007; Higher Education Founding Council 2008, Glass et al., 2006). This paper will present both the quantitative and qualitative data from a two-phase mixed method study with 75 nurse lecturers and 62 nursing students in one university in the United Kingdom. The study investigated the notion that lecturing has similarities to acting (Street, 2007). The findings presented here are concerned with how students perceived lecturers’ level of confidence and how lecturers believed they demonstrated confidence. In phase one a specifically designed questionnaire was distributed to both lecturers and students and a response rate of 91% (n=125) was achieved, while in phase two 12 in-depth semi-structured interviews were conducted with lecturers. Results suggested that students in a lecture could identify if the lecturer was confident or not by the way they performed a lecture. Students identified 57 manifestations of non-confidence and lecturers identified 85, while 57 manifestations of confidence were identified by students and 88 by lecturers. Overall, these fell into 12 main converse categories, ranging from body language to the use of space within the room. Both students and lecturers ranked body language, vocal qualities, delivery skills, involving the students and the ability to share knowledge as the most evident manifestations of confidence. Elements like good eye contact, smiling, speaking clearly and being fluent in the use of media recourses where all seen as manifestations confidence, conversely if these were poorly executed then a presentation of under confidence was evident. Furthermore, if the lecturer appeared enthusiastic it was clearly underpinned by the manifestation of a highly confidence lecturer who was secure in their knowledge base and teaching abilities: Some lecturers do appear enthusiastic but others don’t. I think the ones that do know what they are talking about, you can see it in their voice and in their lively body language. I think they are also good at involving the students even. I think the good ones are able to turn boring subjects into lively and interesting ones. (Student 50) Significantly more lecturers than students felt the lecturer should appear confident when lecturing. The lecturers stated it was particularly important to do so when they did not feel confident, because they were concerned with appearing capable. It seems that these students and lecturers perceived that expressive and apparently confident lecturers can make a positive impact on student groups in terms of involvement in lectures; the data also suggested the reverse, for the under confident lecturer. Findings from phase two indicated that these lecturers assumed a persona when lecturing, particularly, but not exclusively, when they were nervous. These lecturers went through a process of assuming and maintaining this persona before and during a lecture as a way of promoting their internal perceptions of confidence but also their outward manifestation of confidence. Although assuming a convincing persona may have a degree of deception about it, providing the knowledge communicated is accurate, the deception may aid rather than hinder learning, because enhances the delivery of a lecture. Therefore, the deception of acting a little more confidently than one feels might be justified when the lecturer knows the knowledge they are communicating is correct, unlike the Dr Fox Effect where the person delivering a lecture is an actor and does not know the subject in any detail or depth and where the deception to be justified (Naftulin, et al., 1973). In conclusion, these students and lecturers perceive that confident and enthusiastic lecturers communicate their passion for the subject in an interesting and meaningful manner through the use of their voice, body, space and interactions in such a way that shows confidence in their knowledge as well as their teaching abilities. If lecturers, therefore, can take a step back to consider how they deliver lectures in apparently confident ways this may increase their ability to engage their students and not only help them being perceived as good lecturers, but also contribute to the genuine act of education.

A case study of the effectiveness of the electronic survey as a research tool for measuring students' experience of e-learning

This paper uses a case study approach to consider the effectiveness of the electronic survey as a research tool to measure the learner voice about experiences of e-learning in a particular institutional case. Two large scale electronic surveys were carried out for the Student Experience of e-Learning (SEEL) project at the University of Greenwich in 2007 and 2008, funded by the UK Higher Education Academy (HEA). The paper considers this case to argue that, although the electronic web-based survey is a convenient method of quantitative and qualitative data collection, enabling higher education institutions swiftly to capture multiple views of large numbers of students regarding experiences of e-learning, for more robust analysis, electronic survey research is best combined with other methods of in-depth qualitative data collection. The advantages and disadvantages of the electronic survey as a research method to capture student experiences of e-learning are the focus of analysis in this short paper, which reports an overview of large-scale data collection (1,000+ responses) from two electronic surveys administered to students using surveymonkey as a web-based survey tool as part of the SEEL research project. Advantages of web-based electronic survey design include flexibility, ease of design, high degree of designer control, convenience, low costs, data security, ease of access and guarantee of confidentiality combined with researcher ability to identify users through email addresses. Disadvantages of electronic survey design include the self-selecting nature of web-enabled respondent participation, which tends to skew data collection towards students who respond effectively to email invitations. The relative inadequacy of electronic surveys to capture in-depth qualitative views of students is discussed with regard to prior recommendations from the JISC-funded Learners' Experiences of e-Learning (LEX) project, in consideration of the results from SEEL in-depth interviews with students. The paper considers the literature on web-based and email electronic survey design, summing up the relative advantages and disadvantages of electronic surveys as a tool for student experience of e-learning research. The paper concludes with a range of recommendations for designing future electronic surveys to capture the learner voice on e-learning, contributing to evidence-based learning technology research development in higher education.

Interprofessional attitudes amongst undergraduate students in the health professions: a longitudinal questionnaire survey

Background: Interprofessional education (IPE) introduced at the beginning of pre-registration training for healthcare professionals attempts to prevent the formation of negative interprofessional attitudes which may hamper future interprofessional collaboration. However, the potential for IPE depends, to some extent, on the readiness of healthcare students to learn together. Objectives: To measure changes in readiness for interprofessional learning, professional identification, and amount of contact between students of different professional groups; and to examine the influence of professional group, student characteristics and an IPE course on these scores over time. Design: Annual longitudinal panel questionnaire survey at four time-points of pre-registration students (n = 1683) drawn from eight healthcare groups from three higher education institutions (HEIs) in the UK. Results: The strength of professional identity in all professional groups was high on entry to university but it declined significantly over time for some disciplines. Similarly students’ readiness for interprofessional learning was high at entry but declined significantly over time for all groups, with the exception of nursing students. A small but significant positive relationship between professional identity and readiness for interprofessional learning was maintained over time. There was very minimal contact between students from different disciplines during their professional education programme. Students who reported gaining the least from an IPE course suffered the most dramatic drop in their readiness for interprofessional learning in the following and subsequent years; however, these students also had the lowest expectations of an IPE course on entry to their programme of study. Conclusion: The findings provide support for introducing IPE at the start of the healthcare students’ professional education to capitalise on students’ readiness for interprofessional learning and professional identities, which appear to be well formed from the start. However, this study suggests that students who enter with negative attitudes towards interprofessional learning may gain the least from IPE courses and that an unrewarding experience of such courses may further reinforce their negative attitudes.